SHUNIT: Style Harmonization for Unpaired Image-to-Image Translation

نویسندگان

چکیده

We propose a novel solution for unpaired image-to-image (I2I) translation. To translate complex images with wide range of objects to different domain, recent approaches often use the object annotations perform per-class source-to-target style mapping. However, there remains point us exploit in I2I. An each class consists multiple components, and all sub-object components have characteristics. For example, car CAR body, tires, windows head tail lamps, etc., they should be handled separately realistic I2I The simplest problem will more detailed component than simple annotations, but it is not possible. key idea this paper bypass by leveraging original input image because include information about characteristics components. Specifically, pixel, we only gap between source target domains also pixel’s determine pixel. end, present Style Harmonization translation (SHUNIT). Our SHUNIT generates new harmonizing domain retrieved from memory an style. Instead direct mapping, aim styles harmonization. validate our method extensive experiments achieve state-of-the-art performance on latest benchmark sets. code available online: https://github.com/bluejangbaljang/SHUNIT.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Supplementary Material for “Adversarial Inverse Graphics Networks: Learning 2D-to-3D Lifting and Image-to-Image Translation from Unpaired Supervision”

Here we discuss the benefits of using non-parametric and domain-specific renderers, over learned decoders. Both the proposed model and CycleGAN [5] can be viewed as autoencoders: the input is first transformed into a target domain, and then transformed back to its original space. A parametric decoder could be more desirable, for the reason that we do not need to hand-engineer a mapping function...

متن کامل

Image to Image Translation for Domain Adaptation

We propose a general framework for unsupervised domain adaptation, which allows deep neural networks trained on a source domain to be tested on a different target domain without requiring any training annotations in the target domain. This is achieved by adding extra networks and losses that help regularize the features extracted by the backbone encoder network. To this end we propose the novel...

متن کامل

Characteristics of Smoothing Filters to Achieve the Guideline Recommended Positron Emission Tomography Image without Harmonization

Objective(s): The aim of this study is to examine the effect of different smoothing filters on the image quality and SUVmax to achieve the guideline recommended positron emission tomography (PET) image without harmonization. Methods: We used a Biograph mCT PET scanner. A National Electrical Manufacturers Association (NEMA) the International Electrotechnical Commission (IEC) body phantom was fil...

متن کامل

Supplementary Material: Deep Image Harmonization

To validate the effectiveness of our joint training scheme, we also try an alternative of incorporating an off-the-shelf state-of-the-art scene parsing model [3] into our single encoder-decoder harmonization framework to provide semantic information. This network architecture is shown in Figure 1. We show quantitative comparisons on our synthesized dataset in Table 1 and 2. The MSE and PSNR of ...

متن کامل

Appearance Harmonization for Single Image Shadow Removal

Shadow removal is a challenging problem and previous approaches often produce de-shadowed regions that are visually inconsistent with the rest of the image. We propose an automatic shadow region harmonization approach that makes the appearance of a de-shadowed region (produced using any previous technique) compatible with the rest of the image. We use a shadow-guided patch-based image synthesis...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Proceedings of the ... AAAI Conference on Artificial Intelligence

سال: 2023

ISSN: ['2159-5399', '2374-3468']

DOI: https://doi.org/10.1609/aaai.v37i2.25324